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Abstract 

We study the quantum moment problem: Given a conditional probability distribution to- 
gether with some polynomial constraints, does there exist a quantum state p and a collection 
of measurement operators such that (i) the probability of obtaining a particular outcome when 
a particular measurement is performed on p is specified by the conditional probability distribu- 
tion, and (ii) the measurement operators satisfy the constraints. For example, the constraints 
might specify that some measurement operators must commute. 

We show that if an instance of the quantum moment problem is unsatisfiable, then there 
exists a certificate of a particular form proving this. Our proof is based on a recent result in 
algebraic geometry, the noncommutative Positivstellensatz of Helton and McCullough [Trans. 
Amer. Math. Soc, 356(9):3721, 2004]. 

A special case of the quantum moment problem is to compute the value of one-round multi- 
prover games with entangled provers. Under the conjecture that the provers need only share 
states in finite-dimensional Hilbcrt spaces, we prove that a hierarchy of semidefinite programs 
similar to the one given by Navascues, Pironio and Acfn [Phys. Rev. Lett., 98:010401, 2007] 
converges to the entangled value of the game. It follows that the class of languages recognized 
by a multi-prover interactive proof system where the provers share entanglement is recursive. 
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1 Introduction 



The study of multi-prover games has led to many exciting results in classical complexity theory. A 
one-round multi-prover cooperative game of incomplete information is a game played by a verifier 
against two provers, Alice and Bob. The strategy of the verifier is fixed. He randomly chooses two 
questions according to some fixed probability distribution and sends one question to each prover. 
Alice and Bob then each return an answer to the verifier. The verifier decides whether to accept 
these answers on the basis of some pre-defined rules of the game that specify whether the given 
answers are winning answers for the questions sent. To win the game, Alice and Bob may thereby 
agree on any strategy beforehand, but they may no longer communicate once the game has started. 
The maximum probability with which Alice and Bob can cause the verifier to accept is known as 
the value of the game. A simple example is the well-known CHSH game [14^ 115] . In this case, the 
questions and answers are bits. The verifier chooses questions s £ {0, 1} and t £ {0, 1} uniformly 
at random and sends s to Alice and t to Bob. In order to win the game, Alice and Bob must reply 
with bits a,b G {0, 1} such that s A t = a © b, i.e., the logical AND of s and t should be equal to 
the XOR of a and b. It is straightforward to verify that the CHSH game has value 3/4. 

Interactive proof systems have received considerable attention since their introduction by Babai [2] 
and Goldwasser, Micali and Rackoff [20J in 1985. Of special interest to us are proof systems with 
multiple provers [31 [TO] [T7\ [TH] [29] as introduced by Ben-Or, Goldwasser, Kilian and Widger- 
son [5], which can be described in terms of multi-prover games between a verifier, and two or more 
provers. Whereas the provers are computationally unbounded, the verifier is limited to probabilistic 
polynomial time. Both the provers and the verifier have access to a common input string x. The 
goal of the provers is to convince the verifier that x belongs to a pre-specified language L. The 
verifier's aim, on the other hand, is to determine whether the provers' claim is indeed valid. In each 
round, the verifier sends a poly(|x|) size query to the provers, who return a polynomial size answer. 
At the end of the protocol, the verifier either accepts, meaning that he concludes x S L, or rejects, 
based on the messages exchanged and his own private randomness. A language L has a multi-prover 
interactive proof system if there is a protocol such that, if x E L, there exist answers the provers 
can give which will cause the verifier to accept with high probability. However, if x £ L, then there 
exists no strategy for the provers that will only cause the verifier to accept, except with very low 
probability. Here, x and L lead to particular game. Let MIP denote the class of languages having a 
multi-prover interactive proof system. It has been shown that classical two-prover interactive proof 
systems are just as powerful as proof systems involving more than two provers. Indeed, Babai, 
Fortnow and Lund [3], and Feige and Lovasz [18] have shown that a language is in NEXP if and 
only if it has a iwo-prover one-round proof system, i.e., MIP = NEXP. 

1.1 Multi-prover games with entanglement 

In this paper, we study multi-prover games in a quantum setting. In particular, we allow Alice and 
Bob to share an entangled quantum state as part of their strategy. After receiving their questions, 
the provers may perform any local measurement on their part of the entangled state, and decide on 
an answer based on the outcome of their measurement. All communication between the verifier and 
the provers remains classical. It turns out that sharing entanglement can increase the probability 
that the provers can cause the verifier to accept, an effect known as quantum nonlocality. For 
example, if the provers share a maximally entangled state of two qubits they can win the CHSH 
game (cause the verifier to accept) with probability Pc HSH ~ 85% > 3/4. 
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We write MIP* for the set of languages that have interactive proofs with entangled provers. 
Very little is known about MIP*. Most importantly, it was not known before our work whether 
there exists an algorithm of any complexity for deciding membership in MIP* , except for extremely 
restricted classes of games. In particular, if we restrict to games where Alice and Bob each answer 
a single bit a, b G {0,1}, and the verifier only looks at the XOR of these two bits, then the 
(entangled) value of the game can be computed in time polynomial in the number of questions |12] 
115] . Let ©MIP [2] denote the restricted class where the verifier's output is a function of the XOR 
of two binary answers. Then ©MIP* [2] C EXP [15], while it is known that ©MIP = NEXP, for 
certain completeness and soundness parameters [22], i.e., the resulting proof system is significantly 
weakened if the provers are allowed to share entanglement. In fact, such a proof system can even 
be simulated using just a single quantum prover, i.e., ©MIP*[2] C QIP(2) C EXP [551 [27] . 

Unfortunately, very little is known for more general games where we allow shared entanglement 
between the provers, and where Alice and Bob give much longer answers, or when we have more 
than two provers. Unlike in the classical case, general multi-prover games are not equivalent to 
two-prover games when the provers share entanglement [25]. For two-prover unique games (where 
for each pair of questions there exists exactly one pair of winning answers), it is known that we can 
approximate the value of a two-prover game to within a certain accuracy in polynomial time |26j. 
Masancs [33j has shown how to compute the value of multi-prover games where the questions to, 
and the answers from each prover are bits. But even for very small games with a very limited 
number of questions, the entangled value is typically unknown [9]. 

Assuming that the provers share quantum entanglement is a reasonable model because it cap- 
tures the properties of a multi-prover game that a verifier can enforce physically: while the verifier 
can enforce the condition that the provers cannot communicate by ensuring that they are spacelike- 
separated, he has no way to ensure that provers in a quantum universe do not share entanglement. 
Multi-prover games with entangled provers are also known as non-local games with entanglement. 
The entangled value of a game is the maximum probability with which Alice and Bob can win 
using entanglement. Here, we are concerned with the following question: How can we compute the 
entangled value of non-local games with multiple provers? And, how can we decide membership of 
MIP*? 

1.2 Results 

Quantum moment problem. To reach our goal, we first introduce the quantum moment prob- 
lem that is a generalization of our problem. Informally, the quantum moment problems asks whether 
given a conditional probability distributions and some polynomial constraints on observables, we 
can find a quantum state and quantum measurements satisfying the constraints, that provide us 
with the required probabilities. We may use the constraints to impose certain restrictions on the 
form of our quantum measurements. For example, we may want to demand that two measurement 
operators act on two or more distant subsystems independently. Determining whether there is an 
entangled strategy for a multi-prover game that achieves a certain winning probability is a special 
case of the quantum moment problem. 

Other special cases of the quantum moment problem include the so-called classical marginal 
problem [51], which asks whether given certain marginal distributions, we can find a joint distribu- 
tion that has the desired marginals. Our problem is also closely related to the quantum marginal 
problem in which the aim is to find a density matrix for a multipartite quantum system that is 
consistent with a specified set of reduced density matrices for specific subsystems. This problem is 
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QMA-complete and has attracted a lot of interest recently [32] . A special case is iV-representability, 
an important problem with a long history in quantum chemistry [28J . One key difference between 
our quantum moment problem and the quantum marginal problem is that in the latter case the 
dimension of the quantum state, and its various subsystems, is specified. In the quantum moment 
problem the aim is to find a state satisfying the given constraints in a quantum system of any, 
possibly infinite, dimension. Finally, it may also be possible to treat games with quantum verifier 
within the framework of the quantum moment problem. 

Refuting unsatisfiable instances. We describe a general way of proving that an instance of a 
quantum moment problem is unsatisfiable. The proof follows from a recent result of Helton and 
McCullough [23], a Positivstellensatz for polynomials in noncommuting variables. The choice of 
polynomials will define a particular instance of the quantum moment problem, where the variables 
correspond to measurement operators. In Helton and McCullough's result the noncommuting 
variables are required to satisfy certain polynomial equality and inequality constraints but can be 
evaluated in any quantum system, even one of infinite dimensions. Informally, the Positivstellensatz 
states that any such polynomial that is positive can be written a sum of squares, a form that makes 
it obvious that the polynomial is positive. By positive we mean that, whenever the constraints 
are satisfied, the polynomial is positive semidefinite, i.e. it has a positive expectation value for all 
quantum states in whatever quantum system. Such a representation as a sum of squares acts as 
a certificate for the unsatisfiability of an instance of a quantum moment problem. Certificates of 
this kind have often been used in the theoretical physics literature to place very general bounds 
on quantum correlations (see for example [IS]). Helton and McCullough's result shows that such 
certificates are all that is ever required to demonstrate that an instance of the quantum moment 
problem is unsatisfiable. 

Tensor products and commutation. In order to apply the Positivstellensatz to obtain bounds 
on the entangled values of two-prover games, we need to incorporate a constraint in the corre- 
sponding quantum moment problem that ensures Alice and Bob's measurements act on different 
subsystems TCa and TCb- When Alice and Bob share a quantum system of some finite dimen- 
sion, this means that one demands that the Hilbert space TC describing this system decomposes 
as TL = Ha ®7~Lb- Alice and Bob's measurements should be of the form A s ® B t with A s £ TCa 
and Bt S for all questions s and t. Unfortunately, we can only apply the Positivstellensatz 
when the constraints are polynomials in A s and Bf. Thus we need an additional trick to impose 
an explicit tensor product structure. To get around this problem, we demand that for all s and t 
we have [A s , Bt] = 0, i.e., that all measurement operators of Alice commute with all those of Bob. 
If the Hilbert space is finite-dimensional, then imposing the commutativity constraints is actually 
equivalent to demanding a tensor product structure. This result is well-known in the mathemat- 
ical physics literature [45]. Here, we provide a simple version of this argument accessible from a 
computer science perspective, which directly applies to our analysis of multi-prover games. 

From a physics point of view, however, the usual requirement on observables that can be 
measured in space-like separated regions is that they should commute, not that they should have 
a tensor product factorization. Indeed, this commutativity requirement on local observables is 
regarded by many as an axiom that should be satisfied by any reasonable quantum mechanical 
theory of nature [21]. Unfortunately, when the algebra of observables cannot be represented on 
a finite-dimensional Hilbert space it is an open question whether this commutativity property 
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implies the existence of a tensor product factorization. Our results will provide bounds on the 
values of multi-prover games that are valid for all quantum systems whenever the observables of 
different players commute. We will refer to the maximum probability of winning a game G with 
(possibly) infinite-dimensional operators satisfying commutativity constraints as the field-theoretic 
value u)f (G) of the game. It is an open question whether this is the same as the usual entangled 
value of the game. Since MIP* was defined with a tensor product structure in mind, we here define 
the class MIP' , where the tensor products are replaced by the commutative requirement. The class 
MIP' seems more appropriate to our main motivation of studying the power of multi-prover games 
where the provers are only limited by what they can achieve physically. Restricting Alice and Bob 
to sharing finite-dimensional systems does not seem natural from a physical perspective. 

A hierarchy of semidefinite programs. We know that the Positivstellensatz leads to certifi- 
cates that tell us when a particular quantum moment problem is unsatisfiable. But how can we 
find such certificates? If we place a bound on the size of the certificate, then the problem of deter- 
mining whether there exists a certificate of that size can be formulated as a semidefinite program 
(SDP) [471 E] ■ In particular, searching for certificates of increasing size yields a hierarchy of SDPs. 
The resulting hierarchy is very similar to the one presented in a groundbreaking paper of Navascues, 
Pironio and Acm [36], which partly motivated this work. 

In many applications, including multi-prover games, we are not only interested in whether a 
specific instance of the moment problem is satisfiable but in finding the best possible bound on 
some linear combination of moments. Once again fixing the size of the certificates of infeasibility 
straightforwardly leads to a hierarchy of SDPs that provide progressively tighter bounds. For 
multi-prover games G, it was previously not known whether the solutions to this hierarchy of SDPs 
converged to the entangled value of the game, which we denote by u>*(G). Here we almost show 
this. What we actually show is that the hierarchy converges to the field-theoretic value (see above) 
of a non-local game G. In the language of the quantum moment problem, we wish to know if there 
exists an entangled strategy for G such that the provers win with some fixed probability p. However, 
the Positivstellensatz only yields a certificate that there is no entangled strategy that wins with 
probability p if there is also no such strategy even with infinite- dimensional measurement operators. 
If the measurement operators are infinite-dimensional, then the commutativity constraints do not 
necessarily imply the existence of a tensor product structure. In other words, we show that our 
hierarchy converges to the field-theoretic value of the game. 

MIP* is recursive Since our hierarchy converges, we can compute the value of an entangled 
game and hence obtain an algorithm for deciding membership of MIP* (under the assumption that 
the optimal value is achieved with finite-dimensional operators) and of MIP A This implies that 
these classes are recursive. 

Examples: The ^3322 inequality and Yao's inequality. Finally, we demonstrate the power of 
our technique by providing an extremely simple, algorithmically constructed, certificate bounding 
the value of a two-party Bell inequality [3] known as the ^3322 inequality [16], and a multi-player 
non-local game suggested by Yao and collaborators [50] • 
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1.3 Open Questions 

With respect to the above discussion, it would be interesting to know whether there are games 
G such that uj*(G) is strictly less than u*(G). Can it really help the provers to have infinite- 
dimensional systems when the number of questions and answers in the game are finite? One 
way to establish that there is no advantage to having infinite-dimensional systems would be to 
'round' the SDP hierarchy directly to a quantum strategy with finite entanglement, bypassing the 
(nonconstructive) Positivstellensatz altogether. For XOR-games, the first level of our hierarchy is 
tight and it is well-known how a solution of the SDP can be transformed into a quantum strategy via 
so-called Tsirelson's vector construction 112 1 fT5] . However, there exist many non-local games, 
for which the first level of the hierarchy does not provide us with the optimal value of the game, but 
merely gives us an upper bound. This fact alone shows that for general games, we cannot find such 
a nice embedding of vectors into observables as can be done for XOR-games. However, something 
similar may still be possible for restricted classes of games, exhibiting a likewise special structure. 

We also do not establish anything about the rate of convergence of the SDP hierarchy. In some 
numerical experiments with small games, the low levels of the SDP hierarchy do yield optimal 
solutions. Establishing this in general would provide an upper bound on MIP*. We have made 
partial progress on this question by proving convergence for a particular hierarchy of SDPs. 

1.4 Related work 

In Ref. [36], a paper which partly inspired this work, Navascues, Pironio, and Acm (NPA), defined 
a closely related semidefinite programming hierarchy. Subsequently, and independently of us, NPA 
have proved that their semidefinite programming hierarchy converges to the field-theoretic value of 
the game [M|. Our paper and theirs are complementary: While our work emphasizes the connection 
with Positivstellensatz of Helton and McCullough, NPA prove convergence directly. Their proof 
has a number of advantages: most notably, when their hierarchy converges to the field-theoretic 
value of the game at a finite level, NPA obtain a bound on the dimension of the state required to 
reproduce the correlations. NPA have also shown that their new technique for proving convergence 
can be extended to general polynomial optimization problems in noncommutative variables [35]. 

Finally, our techniques have recently extended by Ito, Hirotada, and Matsumoto to the case of 
games with quantum messages between verifier and provers [24] . 

1.5 Outline 

In Section [2j we provide an introduction to non-local games including all necessary definitions. 
Section [3] then defines the quantum moment problem, and Section U] introduces our main tools. 
In particular, Section 14.11 provides an explanation of why we obtain a tensor product structure 
from commutation relations, and in Section 14.21 we show that if a quantum moment problem is 
unsatisfiable, we can find certificates of this fact using the Positivstellensatz. We then use these 
tools in our SDP hierarchy in Section [5] and conclude in Section 15.21 with some explicit examples. 
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2 Preliminaries 



2.1 Notation 

We assume general familiarity with the quantum model [37] . In the following, we use to denote 
the conjugate transpose of a matrix A. A matrix is Hermitian if and only if A^ = A. We write 
A > to indicate that a matrix A is positive semidefinite, i.e., it is Hermitian and has no negative 
eigenvalues. We also use A = to express that A is the all- zero matrix and A ^ to indicate 
that A has at least one non-zero entry. The (i,j)-entry of A will be denoted by For two 

matrices A and B we write their commutator as [A, B] = AB — BA. We use Ti to denote a Hilbert 
space and TL^ the Hilbert space belonging to subsystem k. 1^ is the identity on system k, and M(H) 
denotes the set of all bounded operators on the Hilbert space 7i. Unless stated otherwise, we take 
all systems to be finite-dimensional. We will also employ the shorthand 

M(H) xn :=M(H) x ... x M(7i) 



for the n-fold Cartesian product of M(7i), and let [n] := {1, . . . , n}. Furthermore, we will use |<S| 
and \C\ to denote the number of elements of a set S and list C respectively. 

For the purpose of subsequent discussion, we now note that a Hermitian polynomial p(X) in 
noncommutative variables X = (Xi, . . . ,Xk) is a sum of squares (SOS) if there exist polynomials 
(matrices) r,- of appropriate dimension such that 

V{X) = Yl r ] r r 
j 

It is important to note that if p(X) is an SOS polynomial, it is also a positive semidefinite matrix, 
i.e., p(X) > 0. 

2.2 Games 

As an example application of the quantum moment problem, we will consider cooperative games 
among n parties. For simplicity, we first describe the setting for only two parties, henceforth called 
Alice and Bob. A generalization is straightforward. Let S, T, A and B be finite sets, and it a 
probability distribution on 5 x T. Let V be a predicate on S x T x A x B. Then G = G(V, it) is 
the following two-person cooperative game: A pair of questions (s,t) £ S x T is chosen at random 
according to the probability distribution n. Then s is sent to Alice, and t to Bob. Upon receiving 
s, Alice has to reply with an answer a £ A. Likewise, Bob has to reply to question t with an answer 
b £ B. They win if V(s,t, a, b) = 1 and lose otherwise. Alice and Bob may agree on any kind 
of strategy beforehand, but they are no longer allowed to communicate once they have received 
questions s and t. The value uj{G) of a game G is the maximum probability that Alice and Bob 
win the game. In what follows, we will write V(a, b\s,t) instead of V(s,t,a,b) to emphasize the 
fact that a and b are answers given questions s and t. 

Here, we are particularly interested in non-local games and where Alice and Bob are allowed 
to share an arbitrary entangled state \ifj) to help them win the game. Let TCa and 7Y_g denote the 
Hilbert spaces of Alice and Bob respectively. The state G TLa <8> 7~Lb is part of the quantum 
strategy that Alice and Bob can agree on beforehand. This means that for each game, Alice and 
Bob can choose a specific \tp) to maximize their chance of success. In addition, Alice and Bob can 



6 



agree on quantum measurements where we may without loss of generality assume that these are 
projective measurements [15] For each s £ S, Alice has a projective measurement described by 
{Ag : a G A} on TLa- For each t G T, Bob has a projective measurement described by {-B^ : b G 5} 
on TCb- For questions (s,i) G S x T, Alice performs the measurement corresponding to s on her 
part of which gives her outcome a. Likewise, Bob performs the measurement corresponding to 
t on his part of with outcome b. Both send their outcome, a and b, back to the verifier. The 
probability that Alice and Bob answer (a, b) G A x B is then given by 
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We can now define: 



Definition 2.1. The entangled value of a two-prover game with classical verifier G = G(tt,V) is 
given by: 

lo*(G) = lim max max V tt(s, t)V{a, b\s, t)(ip\A% ® B f 6 |^), (1) 

|| |V> ||=1 a ' M >* 

where A£ G M(H A ) and B t 6 G B(W B ) for some Hilbert space H = H A ® H B , satisfying A%, B\ > 0, 
J2 a K = Ia, Eb B t = f B for all s G S and t G T. 

We also define a more general version of this statement, which will provide an upper bound to 
the quantum value of the game: 

Definition 2.2. The field-theoretic value of a two-prover game with classical verifier G = G(ir, V) 
is given by: 

u*{G) = sup || Y, K(s,t)V(a,b\s,t)A a s B b t , (2) 



a,b,s,t 



where ||0|| is the operator norm of O, A" G M(7i) and 1?^ G B(W) for some Hilbert space TL, 
satisfying A a s , B b t > 0, £ a A a s = £ 6 B b t = I for all s, t, and [A a s , B$] = for all s G S, t G T, a G A, 
and 6 G 5. 

Lemma 2.3. Xei G = G(vr, V) 6e a two-prover game with classical verifier. Then u>*(G) < (G). 

Proof. Let e > 0. Choose d sufficiently large so that there is a normalized state l^) and operators 
Ag, B b defining a strategy with winning probability at least oj*(G) — e. Let A® = A^ <S> Ib and 
B b = Ij4 (g> i?j . Then ^4° and -Bj are positive semidefinite operators on C^ 2 satisfying all the 
conditions in Definition 12,21 Finally, 



uj f (G) = sup I Y n(s,t)V(a,b\s,t)A%B. 

A",B~i a ,b,s,t 



> 



]T 7r(s,t)V(a,b\s,t)A a s B 
Y 7T(s,t)V(a,b\s,t)A a s B L t 



a,b,s,t 
>(, 

a,b,s,t 

>uj*(G)-s 



1 By Neumark's theorem, any generalized measurements described by positive-operator-valued measure can be 
implemented as projective measurements in some higher dimensional Hilbert space. See, for example, pp. 285 of 
Ref. EH. 
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Since e was arbitrary, the result follows. 
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In our examples, we will sometimes use the term Bell inequality^ to refer to a particular non- 
local game. This is an equivalent formulation, where we only consider terms of the form (ip\AgB^\ijj) . 
The value of the game can then be obtained by averaging. In inequalities where Alice and Bob 
have, respectively, two measurement outcomes for each possible choice of measurement setting (i.e., 
A = B = {0, 1}), their measurements can be described by observables of the form A s = A® — A\ 
and Bt = B® — B\ respectively. In this case, we state inequalities in the form of the observables A s 
and Bt where we will use the shorthand (A S B S ) = {ip\A s B s \ip) . 

Note that it is straightforward to extend the above definitions to the setting involving multiple 
players, but the resulting terms will be much harder to read. When considering games among 
N players Pi, ... , Pn, let Si, ... , Sn and Ax, ... } An be finite sets corresponding to the possible 
questions and answers respectively. Let 7r be a probability distribution on 5i x ... x Sn, and let 
V be a predicate on Ax x . . . x An x Si x . . . x Sn- Then G = G{V, tt) is the following iV-player 
cooperative game: A set of questions (si, . . . , sn) 6 Si x ... x Sn is chosen at random according to 
the probability distribution tt. Player Pj receives question Sj, and then responds with an answer 
aj G Aj. The players win if and only if V(ax, . . . , cln\si, . . . , sn) = 1- Let denote the players' 
choice of state, and let Xj := {Xs- \ aj G Aj} denote the positive-operator-valued measure(ment) 
(POVM) of player Pj for question Sj G Sj, i.e., J2 a ^tj = % and Xg] > for all aj. The value of 
the game can now be written as 

oj*(G) = lim max max V ir(sx, ■ ■ ■ , s N ) V(a 1} . . . , a N \sx, ■ ■ ■ , s N )(^\X^(g). . MX^U), 

1 V = V,/ si,...,s N ai,...,ojv 

II 1^)11=1 

where the maximization is taken over all legitimate POVMs Xj for all j G [N]. Similarly, we can 
now write the field-theoretic value of the game as 

u f (G)= sup II ^7r( Sl ,..., Sjv ) Y,V(ax,...,a N \sx,...,SN)X£...X«»\\, 

X U ...,X N S1) ... )SJV ai,...,ajv 

where we now have ^ X^ = I for all aj, Sj,j and [X^ , X s 3 .',] = for all j ^ j'. 
2.3 Proof systems 

Interactive proof systems can be phrased as such games. For completeness, we here provide a 
definition of MIP. We refer to the introduction and the previous section for an explanation of the 
notions of a tensor product form vs. commutation relations. 

Definition 2.4. For < s < c < 1, let ©MIP* S [A;] denote the class of all languages L recognized 
by a classical Approver interactive proof system with entanglement such that: 

• The interaction between the verifier and the provers is limited to one round and classical 
communication. The verifier chooses k questions from a finite set of possible questions, 
according to a fixed probability distribution known to the provers, and sends one question to 
each prover. Afterwards, the provers may perform any measurement that has tensor product 
form on a shared state \ip) that they have chosen ahead of time. Each prover returns an 
answer to the verifier, whose decision function is known to the provers. 
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• If x G L then there exists a strategy for the provers for which the probability that the verifier 
accepts is at least c (the completeness parameter). 

• If x ^ L then, whatever strategy the k provers follow, the probability that the verifier accepts 
is at most s (the soundness parameter). 

Definition 2.5. For < s < c < 1, let ©MIP^ s [fe] denote the class corresponding to a modified 
version of the previous definition: here we merely ask that the measurements operators between 
the different players commute. 

3 The quantum moment problem 

3.1 General form 

Let us now state the quantum moment problem in its most general form, before explaining its 
connection to non-local games. Intuitively, the quantum moment problem states that given a 
certain probability distribution, is it possible to find quantum measurements and a state that 
provide us with such a distribution? 

Definition 3.1 (Quantum moment problem). Given a list of numbers M = (nii \ rrii G [0, 1]), 
a set of polynomial equations 1Z = {r = | r : M(7i) x ^ M ^ — ► M(H)}, and polynomial inequalities 
S = {s > | s : B(W) X I- M I -» M(H)}, does there exist said Hilbert space H, operators Mi G M(H) 
and a state p G M(H) such that 

1. For all nii G M, Tr(Mip) = mi. 

2. For all r G K, r(M±, M\ M \) = 0. 

3. For all sG 5, s(Mi, . . . , M\ M \) > 0. 

3.2 Non-local games 

In this paper, we are particularly interested in a special case of the quantum moment problem, 
where we consider measurements on many space-like separated systems as in the setting of non- 
local games. For simplicity, we will explain the connection to non-local games for only two such 
systems, Alice T~La and Bob TCb, where it is straightforward to extend our arguments to more than 
two. On each system Ha and TCb, we want to perform a finite set of possible measurements S and 
T each of which has the same finite set of outcomes A and B respectively. Let m A (a\s ) and m B (b\t) 
denote the probability that on systems Ha and we obtain outcomes a £ A and b G B given 
measurement settings s 6 5 and t G T respectively. Furthermore, let m AB (a\s, b\t) denote the joint 
probability of obtaining outcomes a and b given settings s and t when performing measurements 
on systems TCa and TL b ■ 

Informally, our question is now: Given probabilities m AB (a\s, b\t), does there exist a shared 
state p such that we can find measurements on the individual systems Ha and TCb that lead to 
such probabilities? Let's first consider what polynomial equations and inequalities we need to 
express our problem in the above form. First of all, how can we express the fact that we want our 
measurement operators to act on the individual systems Ha and Hb alone? I.e, how can we ensure 
that the measurement operators have tensor product form? We will show in Lemma 14.11 that we 
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are guaranteed to observe such a tensor product form if and only if for all s E S, a E A, t E T and 
b E B we have [A",^] = 0, where we used Ag and B\ to denote the measurement operators of 
Alice and Bob corresponding to measurement settings s and t and outcomes a and b respectively. 
Hence, we need to impose the polynomial equality constraints of the form [Ag, B%] = 0. 

Furthermore, we want that for both systems A and B, we obtain a valid measurement for each 
measurement setting s E S and t E T. I.e., we impose further polynomial equality constraints for 
all s E S and t E T of the form 

A a s - I = and ^^-1 = 0, 

a£A beB 
and finally the following polynomial inequality constraints for all a E A and b E J3 

A£ > and £ t 6 > 0. 

Recall, that we may restrict ourselves to considering projective measurements. We may thus add 
the equality constraints 

{Alf = A a s and {B h t f = B h t , 

which automatically imply that A® , B\ > 0. For simplicity, we will later use this constraint instead 
of the previous one. 

In this paper, we are mainly concerned with the (weighted) average of the probabilities of 
generating certain outcomes in a non-local game. In other words, we wanted to know if there exist 
operators of the above form such that 

v = \\Y, <s,t)V(a,b\s,t)A a s B b t \ 

a,b,s,t 

for some success probability v. Semidefinite programming will allow us to turn the question of 
existence into an optimization problem. 



4 Tools 

For our analysis we first need to introduce two key tools. The first one allows us to deal with the 
fact that we want measurements to have tensor product form. Our second tool is an extension of 
the non-commutative Positivstellensatz of Helton and McCullough to the field of complex numbers, 
from which we will derive a converging hierarchy of semidefinite programs. 

4.1 Tensor product structure from commutation relations 

We now first show that imposing commutativity constraints does indeed give us the tensor product 
structure required for our analysis of non-local games. It is well-known that the following statement 
holds within the framework of quantum mechanics |45j H 

In Appendix |Aj we provide a simple version of this argument accessible from a computer science 
perspective, which directly applies to the task at hand. 

2 an algebra of type-I 
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Lemma 4.1. Let H be a finite- dimensional Hilbert space, and let {X^ G M(H) \ for all j G 
[N] and for all Sj G Sj,aj G Aj}. Then the following two statements are equivalent: 

1. For all j,f G [N], j 7^ f , and all Sj G Sj, Sji G Sj', a, G Aj and aj' G Aj/ it holds that 

2. There exist Hilbert spaces Hi, ■ ■ ■ ,Hn such that H = Hi <S> . • • <8> Hn and for all j G [N], all 
sj G Sj, aj G Aj we have X s - G M(Hj). 

4.2 Positivstellensatz 

Our second tool, the Positivstellensatz (in combination with semidefinite programming) will allow 
us to find certificates for the fact a quantum moment problem is infeasible. For simplicity, we here 
describe the Positivstellensatz from the perspective of non-local games. An extension to the general 
quantum moment problem is possible and will be provided in a longer version of this paper. Our 
results follow almost directly from Helton and McCullough's work and our proof closely follows 
that in Ref. [23]. We have chosen to provide a complete proof of the Positivstellensatz for three 
reasons: (i) the proof is more straightforward in our concrete setting, (ii) Helton and McCullough's 
theorem is formulated for symmetric operators over the field R, and we need to work with Hermitian 
operators over the field C, and (iii) so we can highlight the nonconstructive steps in the proof. We 
first define: 

Definition 4.2 (Convex Cone C-p). Let V be a collection of Hermitian polynomials in (noncom- 
mutative) variables {Xs-}- The convex cone Cp generated by V consists of polynomials of the 
form 

M N L 

i=l i=l j=l 

where pi G V, M, N and L are finite, and rj, Sj,- are arbitrary polynomials. 

In the following, we will call Eq. (J3j) a weighted sum of squares (WSOS) representation of q. 

The purpose of the set V is to keep track of the constraints on the measurement operators. 
Note that when considering the measurement operators for non-local games, it is sufficient for 
us to restrict ourselves to considering (measurement) operators that are positive semidefinite. In 
particular, this means that all operators are Hermitian. The Positivstellensatz as such does not 
require us to deal only with Hermitian variables in the polynomials, but allows us to use any 
noncommuting matrix variables. In the following, we will always take our measurement operators 
to be of the form Xf = (XfyXf. Clearly, X% is itself a Hermitian polynomial in the variable X" . 
For clarity of notation, we will omit this explicit expansion in the future. Note that we will thus 
not impose the constraint that our operators are Hermitian, and this implicit expansion does not 
increase the size of our SDP. 

We can write our constraints in terms of the following sets of Hermitian polynomials. In the 
following, we will use the short hand notation O^j := X^ . . . X2jllX%£ . . . X^ where we leave 
indices Sj and aj implicit, to refer to a product of measurement operators where we exclude player 
j. First, we want measurements on different subsystems to commute. In the multi-party case, this 
gives us the set of polynomials 

Qi = {i[Xs!j , O-j] I for all Sj G Sj, aj G Aj and all O-j}. 
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Second, we want our operators to form valid measurements. 

3,8 j a J 

Finally, by Neumark's theorem [40], we may take our measurement operators to be projectors, this 
gives 

q 3 = (j {(\::f x: : \. 

j,Sj, aj 

It's not hard to see that these constraints actually give us orthogonality of the projectors. For 
clarity, however, we may also include the following sets of polynomials 

Qa = {i[Xsj , X S j ] | for all Sj G Sj and all aj / a'j}, 

Q 5 = { .V"; X$ + X%X% | for all 8j G Sj and all aj + aft, 

which explicitly demand that projectors corresponding to the same Sj are orthogonal. 

Let Q = Qi U Q 2 U Q 3 U Q 4 U Q 5 and let V = Q U (-Q). Note that all polynomials in P are 
Hermitian. It is clear that if the measurement operator satisfy the constraints, then the term 

S ij Pj S ij 

vanishes for arbitrary pj G V and arbitrary polynomial Sj,-. We are now ready to state the Posi- 
tivstellensatz: 

Theorem 4.3 (Positivstellensatz). Let G = G(ir, V) be an N-prover game and let C-p be the cone 
generated by the set V defined above. Set 

q u = ul- ■ ■ ■ , *n) Yl ■■■,a N \si,..., s N )X^ . . . . (4) 

If Qv > 0, then q u G C-p, i.e., 

vl - *( 8 U ■ ■ ■ > s n) Yl y ( ai ' ■■-,a N \su..., s N )X^ . . . = Y r\n + ^ s\ jPi Sij , (5) 

si,...,sjv ai,...,ajv i i,j 

for some pi G V , and some polynomials n, Sy. 

5 Finding upper bounds 

We now show how we can approximate the optimal field-theoretic value of a nondocal game using 
semidefinite programming. We thereby construct a converging hierarchy of SDPs, where each level 
in this hierarchy gives us a better upper bound on the actual value of the game. To this end 
we will use the Positivstellensatz of Theorem 14.31 in combination with the beautiful approach of 
Parrilo |38}I39|. For simplicity, we first describe everything for the two party setting; a generalization 
is straightforward. 
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Recall from Definition 12.21 that if for some real number v we have 

q w = uI-J2 <*, *)V(a, b\s, t)A a s B b t > 0, (6) 

a,b,s,t 

and the operators {^4"} and {B^} form a valid measurement, then v > u>f(G) gives us an upper 
bound for the optimum value of the game. When trying to find the optimal value of the game, 
our task is thus to find the smallest v for which q v > for any choice of measurement operators. 
Clearly, if we could express q v as an SOS for any choice of measurement operators {^4"} an d {B% } 
then q v > and we would also have v > u*(G). Luckily, the Positivstellensatz of Theorem l4.3l gives 
us almost the converse: if q v > 0, then q v can be written as a weighted sum of squares (WSOS). 
Recall from the previous section, that the purpose of the additional term in the weighted sums of 
squares representation is to deal with the constraint that we would like the operators {^4"} an d 
{B^} to form a valid quantum measurement. Note that q v reduces to an SOS if we could express 
q v as a WSOS, i.e., 

M N L 

q u = v\- ^ 7r(s,t)V{a,b\s,t) = ^2rjri + ^2J24jPi s ij^ ( 7 ) 

a,b,s,t i=l i=l j=l 

for some polynomials r\ and Sjj in the variables {^4"} and {B^} in such a way that whenever the 
variables satisfy the constraints the second term in the above expansion vanishes. 

It is not difficult to see that if q v > 0, then there exists no strategy that achieves a winning 
probability of v or higher. Applied to our problem, the Positivstellensatz thus tells us that if 
there exists no strategy that achieves winning probability v, then q u can be written as a weighted 
sum of squares. Intuitively, the WSOS representation of q v thus bears witness to the fact that 
the set of measurement operators and states giving a success probability higher than v is empty. 
The advantage of this procedure is that semidefinite programming can be used to test whether 
polynomials (such as qv) admit a representation as WSOS. In Section I5.2t we will look at some 
specific examples of this approach (see also [391 03] for the analogous treatment for commutative 
variables). 

When trying to find the optimal value of the game, our task is thus to find the smallest v for 
which q u admits a WSOS representation. Hence, we want to 

minimize v 
subject to q v £ C-p. 

Recall that if q v £ C-p, then q v is of the form 

M N L 

9u = Yl r i ri + H S s h Pi Sl i ' ( 8 ) 

i=l i=l j=l 

for some polynomials and s« in the variables {^4"} and {B^}. A point that is worth noting 
now is that in the above optimization, Eq. ([8]) is an identity true for all {^4"}, {B^}, rather than 
an equation that is only true when {^4"}, {B^} correspond to projective measurements. In this, 
the additional term is rather similar to the Lagrange multipliers in more conventional constrained 
optimizations. 
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5.1 SDP hierarchy 



The main difficulty now is that we do not know how large the WSOS representation of q v has to be. 
That is, we do not know ahead of time how large we need to choose the degree of the polynomials in 
the representation. The techniques discussed above are therefore not constructive and do not lead 
to a direct computation of u* (G). However it is straightforward to find semidefinite relaxations 
that provide upper bounds on u'{G). In this we simply apply the methods of Parrilo [38l US] for 
the case of polynomials of commutative variables. The main requirement is to fix an integer n 
and look for a sum of squares decomposition for q v that has a total degree of at most 2n. Letting 
v = ujf (G) + e, this means that e may not be made arbitrarily small but will always result in an 
upper bound for (G). This upper bound can be computed as an SDP using methods analogous 
to [39]. Consider the problem given above for q v as in Eq. ([8]). Notice that all of the constraint 
polynomials pi defined in Section 14.21 have total degree less than or equal to 2 so we require that 
each n is of total degree n and each Sj is of total degree at most n — 1. The lowest level of the 
hierarchy has n = 1 and corresponds to applying the method of Lagrange multipliers to finding 
the quantum value of the game. In the following, we use the term level n to refer to a level of the 
hierarchy where the total degree of q v is 2n when concerned with a bipartite game. For a game G, 
denote the solution to the SDP at level n as uj^ p (G). It should be clear that if q v has a WSOS 
decomposition of degree 2n, it must also have a WSOS decomposition with higher degree. As such, 
the optimum derived from the hierarchy of SDPs must obey the following inequalities: 

uf p {G)>uf p (G)>--->u>t P {G). (9) 

Theorem 5.1. The solutions to the SDP hierarchy converge to ujf(G), i.e., lim n - f00 u>n P = ujf(G). 

Proof. That u^ p (G) > (jf(G) follows from our discussion above. To prove convergence, we use the 
Positivstellensatz given by Theorem 14.31 Fix e > and let v = oj*(G) + e with q u defined as in 
Eq. (j3|). By Theorem 14.31 Qu has a representation as a WSOS, 

M N L 

i=l i=l j=l 

Let 2D be the maximum degree of any of the polynomials rjr-i and s\-piSij that occurs in the 
above expression. Then, if we consider a level D SDP relaxation, we must necessarily arrive at an 
optimum such that oj s ^ p (G) < u>f (G) + e. Likewise, by choosing e arbitrarily close to zero, there 
is a corresponding SDP with total degree 2n whose optimum o;^ dp (G) is arbitrarily close to ujf (G). 
In particular, from Eq. ([9]), we can see that as n — > oo, the optimum of the SDP hierarchy must 
converge to u* (G). □ 

In Section 15.2.21 we provide a simple example of how the degree of the polynomials can be 
increased when going from level 1 to level 2. There are many connections of this semidefinite 
programming hierarchy to other methods that can be used to bound the quantum values of games. 
In particular, it can be shown that the dual semidefinite programs to this hierarchy are equivalent to 
the moment matrix methods of NPA [36J , thus showing that the hierarchy of semidefinite programs 
discussed in that work converges to the entangled value of the game. Our example of the CHSH 
inequality below demonstrates this connection explicitly. In relation to this, it is worth noting that 
the duality between the two approaches (sum of squares and moment matrix) arises also in the 
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case of commutative variables where the moment matrix methods of Laserre [30] are dual to the 
semidefinite programs discussed by Parrilo [39] . 

5.2 Examples 

5.2.1 CHSH inequality 

We will now look at the simplest non-local game that is derived from the CHSH inequality [14] . In 
particular, we will illustrate how the tools that have we developed allow us to prove that [11] 

Schsh = (AiBi) + (AiB 2 ) + {A 2 B 1 ) - (A 2 B 2 ) < 2^2, 

where Ax, A 2 and B\, B 2 are observables with eigenvalues ±1 corresponding to Alice and Bob's mea- 
surement settings respectively. First of all, note that since we are only interested in the expectation 
values of the form (A\B 2 ) we may simplify our problem: instead of dealing with the probabilities 
of individual measurement outcomes, we are only interested in whether said expectation values can 
be obtained. Here, our constraints become much simpler and we only demand that A? = I, B? = I 
and [Aj,Bk] = for all j,k G {1,2}. The Bell operator for the CHSH inequality is given by [H] 

<6chsh = A\B\ + A\B 2 + A 2 B\ — A 2 B 2 . 

Hence, to find the optimum value our goal is to 

minimize v 

subject to q v = v\ — £>chsh £ Cp- 

The constraint in the above optimization thereby amounts to determining whether q v as written 
above can be cast in the form of a WSOS, which reduces to an SOS for measurement operators 
satisfying the constraints. The numerical package SOSTOOLS [12] gives a frontend to other SDP 
solvers and explains how to apply these techniques in the case of commutative variables. Similar 
ideas can be applied here. However, for our simple example, it is not hard to see how this problem 
can be recast in a language that may be more familiar. 

Since £>chsh is a noncommutative polynomial of degree 2, the lowest level relaxation consists 
of looking for a WSOS decomposition for q v that is of degree 2. To this end, we shall consider a 
vector of monomial of degree 1, namely, z = (A±, A 2 , B±, B 2 y . Our goal is to find a 4 x 4 matrix 
r such that q v = z^Tz whenever the constraints are satisfied. I.e. we have [A,-,£>fc] = for all 
j, k £ {1,2}, and polynomials 

pf-I-iA-f, pf ] :=l-(B 3 )\ j = 1,2, (10) 

and their negations vanish. Evidently, since we want q v to be a Hermitian polynomial, and we 
want our commutation constraints to hold, we may without loss of generality take T to be real and 
symmetric. Note that this already takes care of the commutation constraints. Moreover, since all 
remaining constraints are quadratic, when looking for a WSOS decomposition for q v , it suffices to 
consider s« in Eq. as multiples of I. Let jij = \T)ij, then a small calculation shows that this 
amounts to requiring 

V = 711 + 722 + 733 + 744 

= 712 = 721 = 734 = 743 
-1 = 2713 = 2714 = 2723 

1 = 2 724 , (11) 
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so that 

2 4 

q v = v I - £>chsh = 2 f rz + ^ 7j 3 - p { f ] + ^2 jjj pf_} 2 . 

i=i j=3 

Using the constraints given in Eq. (jllj) . we see that T should be of the form 



(12) 



r = - 



/ 2 7 n 


-1 

V -i 



o 

2722 
-1 
1 



-1 
-1 

2733 




-1 \ 
1 



2744 / 



(13) 



Effectively, V is the matrix obtained by expressing v I — £>chsh — Y^= 



111 



^2 (A) ^4 

the form of z*Tz. Now, if we can find a V > that is of this form, then whenever the polynomials 
given in Eq. (jlOp vanish, q v = z^Tz is an SOS. To see this, note that in this case, we may write 
r = U^DU, where U is unitary and D = diag(dj) only consists of nonnegative diagonal entries. 
Then we can write q u as Y2i di(Uz)\(Uz)i which is clearly an SOS. Conversely, note that if q u is an 
SOS, we can find such a matrix V. Hence, we can rephrase our optimization problem as the SDP 

minimize Tr(r) 
subject to T > 0. 

This is, in fact, exactly the dual of the SDP corresponding to the first level of the SDP hierarchy 
given by NPA [36] . and the dual of the SDP for the special case of XOR games |49j . Solving this 
SDP, one obtains 

(y/2 -1 -1\ 



r 



V2 -1 1 

-1 -1 V2 
V-i 1 V2J 



(14) 



which gives 2^2 as an optimum. From here and Eq. (112j) . it is possible to write down a WSOS 
decomposition for v = 2\/2 as 



2 4 

q 2V - 2 = 2V2I - £chsh = ^(h\hl + h\h 2 ) + -L X>f ) + -1 ][> 

J=l J=3 



(15) 



with /ii = Ai + A2 — V2B\ and J12 = A\ — A2 — V2B2. This immediately implies that whenever 
the constraints are satisfied, q 2y /2 — an d hence /?chsh < 2v2I. It is well known that for the 
CHSH inequality, this bound can be achieved [TTj . 



5.2.2 The ^3322 inequality 

We now consider another example of a two-player game, where the first level of the hierarchy does 
not give a tight bound. The ^3322 inequality [TB] is a Bell inequality phrased in terms of probabilities 
(not expectation values) whereby Alice and Bob can each perform one of three possible two-outcome 
measurements. Without loss of generality, the Bell operator in this case can be written as: 

£3322 = Al{B\ + B\ + Bl) + A a 2 {B\ + B\ - B b 3 ) + A% {B\ - B b 2 ) — A\ — 2B\ - B 2 , 
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where A? and B b = 1,2,3) are projectors corresponding to, respectively, outcome a of Alice's 
i-th measurement and outcome b of Bob's j-th measurement for some fixed a and b. To the best our 
knowledge, the maximum entangled value for -63322, i.e., 0/(13322), is not known. The best known 
lower bound on 0/(13322) is 0.25 [16]; some upper bounds (0.375 [31], 0.3660 [I]) are also known in 
the literature. Here, we will make use of the tools that we have developed to obtain a hierarchy of 
upper bounds on this maximum. In analogous with the CHSH scenario, this corresponds to solving 
the following SDP for some fixed degree of q v : 



minimize v, 

subject to q v = ul — $3322 €E C-p. 



(16) 



In particular, since #3322 is a noncommutative polynomial of degree 2, the lowest level SDP 
relaxation would correspond to choosing a vector of monomials with degree at most one, i.e., 



(I,Al,A a 2 ,AZ,BlB b 2 ,B b 3 ). 



(17) 



We can now proceed analogously to the CHSH case, where we will look for a particular matrix 
r restricted by our constraints, namely, (A?) 2 = A a - and (B b ) 2 = B b for all j 6 {1,2,3}, where 
again for the purpose of implementation, we will implicitly enforce the commutativity conditions 
L4j,.Bj] = for all i,j £ {1,2,3}. Solving the corresponding SDP (Appendix ID.l|h one obtains 
3/8, and the matrix 



sdp / j 
U 1 (^3322 



/ 4 



-1 

1 

2 
1 



1 

2 



V 




2 


-1 
-1 
-1 



-1 

2 

-1 
-1 
1 



1 

2 




1 

-1 
1 





1 

-1 
-1 
-1 

2 





h\ 
-1 

1 







1 / 



which provides a WSOS decomposition for v = 3/8, i.e., 

3 



93/8 



I - #3322 = zTz + ^ 4 Pi S i 



(18) 



where 



Pi 



Af 



B 



(4 a r 



1,2,3, 
4,5,6. 




1,2,4,5, 
3,6. 



(19) 



Given that <-<-' 1 dp (-f3322) is far from the best known lower bound on u>* (1^22)1 it seems natural 
to also look at higher level relaxations for 13322- F° r the next level, we will look for q u that is of 
degree at most 4. Note that we have many options to extend the hierarchy. The easiest way to 
proceed is to extend the vector z by some monomials of degree two in the measurement operators. 
For this we do not even have to consider using all possible degree 2 monomials, but could consider 
only a subset of them such as that given by the following vector 



(I, A1, A a 2 , Al B\, Bl B b 3 , A$B\, AfB b 2 , A\B\, A 2 B\, A a 2 B b 2 , A a 2 B b 3 , A 3 B b , A a 3 B b , A a 3 B b ). (20) 
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In particular, solving the corresponding SDP (Appendix ID.2[) with z given by Eq. (|20p gives an 
optimum that is approximately 0.251 470 90 which is significantly less than 3/8 = 0.375. Clearly, 
we could increase the size of z further by including all relevant monomials of degree 2 or less. 



A%Bl). 



A a A a A a A a A a A a R^ 1 R^ R^ R^ r>6 736 A a rib \a rjb 

, r> 2 , -D 3 , ^1^-2' ^ i l yl 3' ' ' ' ' yl 3 /1 2' - D l- D 2) £> 1 23 3) • • • ) D, A D 1i A \ D \i n -\ D 2i 

Proceeding as before, we end up with the optimum of the second order relaxation lo^ p (I3322) ~ 
0.250 939 72. In the next level, we would then include all monomials of degree 3 and less, and this 
"'(13322) « 0.250 875 56. 



nves oj. 



sdp / 



5.2.3 Yao's inequality 

Finally, we examine a well-known tripartite Bell inequality [50] among three provers: Alice, Bob 
and Charlie. Each prover performs three possible measurements, each of which has two possible 
outcomes. Similarly to the CHSH inequality above, we may thus express each measurement as an 
observable with eigenvalues ±1. For simplicity, let A±, A2, A 3 , B±, B2, B 3 and d, C2, C 3 correspond 
to the observables of Alice, Bob and Charlie respectively. Yao's inequality states that for any shared 
state p we have 

cS Yao = (A X B 2 C 3 ) + (A 2 B 3 d) + (A3B1C2) - (A^d) - (A 2 B 1 C 3 ) - (A 3 B 2 d) < 3^3. (21) 

We now provide a very simple proof of this inequality based on our framework. First of all, 
note that since we are only interested in the expectation values of the form {AiB 2 C 3 ) we may 
again restrict ourselves to dealing only with expectation values in analogy with the CHSH example 
presented above. Our constraints are also analogous to the CHSH case. Among them, we have the 
following constraint polynomials 

pf):=I-(A,) 2 , pf-^I-iBjf, ,f>:=I-(C,)» (22) 

for j = 1, 2, 3. Next, note that the Bell operator for Yao's inequality can be written as [c.f. Eq. (12111 ] 

B Yao = A^Cs + A 2 B 3 d + A 3 B 1 C 2 - A^ 3 d - A 2 B 1 C 3 - A 3 B 2 d, (23) 

which is a noncommutative polynomial of degree 3. 

For our task at hand, we will consider the following SDP relaxation 

minimize u, 

subject to q v = ul — By ao 6 C-p, 



with q u being a polynomial of degree at most 6. As usual, we will implicitly enforce the commu- 
tativity constraints, i.e., [Ai,Bj] = 0, L4j,Cfc] = 0, and [Bj,Ck] = for all k E {1,2,3}. With 
this assumption, it turns out that it suffices to consider the following 25-element vector 



I 



\ 



A 1 B 2 C 3 
A 2 B 3 d 
A 3 B X C 2 
AiB 3 C 2 
A 2 B 1 C 3 
V A 3 B 2 d 



( A 1 B 1 C 2 
A 1 B 2 C 1 
A 2 B 1 C 1 
A1B2C2 
A2B1C2 

V A 2 B 2 d 



/ A^d \ 
A 1 B 3 C 1 
A 3 B x d 

A 3 B\C 3 
\ A 3 B 3 d J 



( A 2 B 2 C 3 \ 
A 2 B 3 d 
A 3 B 2 d 
A 2 B 3 C 3 
A 3 B 2 C 3 
V A 3 B 3 d J 



(24) 
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In this case, since the constraint polynomials given in Eq. (|22p are quadratic, when looking for a 
WSOS decomposition for q u , we will need to consider in Eq. (jSJ) as an arbitrary polynomial of 
Ai, Bj and Ck with degree at most 2. Proceeding in a way analogous to the 2nd level relaxation for 
-^3322 inequality, one obtains the 25 x 25 positive semidefinite matrix T = T7 X 7 0^ =1 r 3x3 , where 
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(25) 



From some simple calculations, it then follows that whenever the constraints Af 
are satisfied, we have 



3V3I-i3 Ya o = z ] Tz 



where 



h. 



■j 
hj,k 



\ J=l i=l j',fc=l,2,3 / 



3731 -B Y ao, 

^iB 2 C 3 + e i ^^A 2 B 3 C 1 + e^'/ 3 U 3 £iC 2 , 
^iS 3 C 2 + e i ^ /3) A 2 B 1 C 3 + e i(4 ^' /3 U 3J B 2 Ci, 
AjBjCk + AjBkCj + A^BjCj. 



(26) 



This makes it explicit that whenever the constraints are satisfied, 3731 — ,8 3322 > and therefore 
<?3322 ^ 373- As a last remark, we note that the constraint term Ylij s tjPi s ij cou ld have been 
included explicitly in the WSOS decomposition for q 3 ^ = 3731 — &Yao and we refer the reader to 
Appendix ID.3I for details. 
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A Tool 1: Tensor product structure from commutation relations 

We now provide a simple proof of Lemma 14. 1 1 from a computer science perspective that is suitable 
to the task at hand. For simplicity, we address the case of two-prover systems in detail, and 
merely sketch the extension to the multiple provers at the end. For ease of reference, we shall now 
reproduce the Lemma for the two-prover setting: 

Lemma A.l. Let H be a finite- dimensional Hilbert space, and let {A^ G M(7i) \ s G S} and 
{Bf G M(7i) | s G T}. Then the following two statements are equivalent: 

1. For all s G S, t G T, a G A and b G B it holds that [A a s , B^] = 0. 
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2. There exist Hilbert spaces TCa,T~(-b such that Ti = Ha <8> Tis and f or all s £ S, a £ A we have 
A a s G M(H A ) and for all t e T , b e B we have B\ G M(H b )- 

For our argument we will not consider individual operators, but instead look at the C*-algebra 
of operators which is well understood in finite dimensions [13 [7]. The C*-algebra of operators A = 
{A\, . . . ,A n } consists of all complex polynomials in such operators and their conjugate transpose: 
if A is an element of the algebra, then so is A' . For example, the set of all bounded operators 
M(Ti) on a Hilbert space Ti is a C*-algebra. For convenience, we will also write si = (A) for 
such an algebra si generated by operators from the set A. We will need the following notions: 
The center 3f of an algebra si is the set of all elements in si that commute with all elements of 
si, i.e., & = {Z\Z G si, MA G si : [Z,A] = 0}. U si C M(Ti) for some Hilbert space Ti, then 
the commutant of si in B(Ti) is given by Comm(^) = {X\X G B(H),VA G si : [X,A] = 0}. 
Furthermore, an algebra si is called simple, if its only ideals^ are {0} and si itself. It is easy to 
see that if si only has a trivial center, i.e., ^ = {cl\c G C}, then si is simple [46] . Finally, si is 
called semisimple if it can be decomposed into a direct sum of simple algebras. 

A.l Optimizing non-local games 

Before we show how to prove Lemma 14. 1[ we first demonstrate that when considering non-local 
games we can greatly simplify our problem and restrict ourselves to C*-algebras that are simple. It 
is well known that we can decompose any finite dimensional algebra into the sum of simple algebras. 

Lemma A. 2 ([IS]). Let si be a finite- dimensional C* -algebra. Then there exists a decomposition 

3 

such that sij is simple. 

We furthermore note that for any simple algebra, the following holds: 

Lemma A. 3 ([46]). Let Ti be a Hilbert space, and let si C B(W) be simple, then there exists a 
bipartite partitioning of the Hilbert space Ti such that Ti = Ti\ (8) Ti2 and si = B(7^i) ® 12- 

We now show that without loss of generality, we may assume that the algebras generated by 
Alice and Bob's measurement operators are in fact simple. 

Lemma A.4. Let Ti = Ti A ®Ti B and let A = {A a s G M(Ti A )} and B = {B b t G M(Ti B )} be the set of 
Alice and Bob's measurement operators respectively. Let p G M(Ti) be the state shared by Alice and 
Bob. Suppose that for such operators we have 

q= E V(a,b\s,t)Tr((A a s ®B b t )p). 

sSS.teT a£A,b£B 

Then there exist measurement operators A = {A a s } and B = {B b } and a state p such 
q< £ tt(M) ]T V(a,b\s,t)Tr((A a s ®B b t )p). 

sSS.teT a£A,b£B 

and the C* -algebra generated by A and B is simple. 

3 An ideal of srf is a subalgebra ^ C srf such that for all / G ^ and A 6 si , we have I A £ J? and AI £ J . 
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Proof. Let = (A) and = (£>). If srf and SS are simple, we are done. If not, we know 
from Lemma [A. 21 and Lemma [A. 31 that there exists a decomposition TCa ®T~Cb = ©jfc^A 
Consider Tr((M A K> M B )p), where M A (8) M B G s$ It follows from the above that (8) M B = 
®j k (j¥ A ®Tl B )MA ® M B (U A <8>II^), where H^ and LT| are projectors onto H A and H k B respectively. 
Let p = @ jk $V A ® n|)p(n J A ® n|). Clearly, 

Tr((M A ® M B )£) = Tr f(EK n i ® n l) M A 8> M B (n J A ® n|)pj = Tr((M A ® M B )p). 

The statement now follows immediately by convexity: Alice and Bob can now measure p {B^ign^} 
and recording the classical outcomes j,k. The new measurements will then be ■ = H^^H^ 
and B\ k = Ii k B B b t Ii k B on state p jk = (U A ® U k B )p(U A ® n|)/Tr((n^ ® n|)p). By construction, 
^ = and J? fc = {B% k } are simple. 

Let qjk denote the probability that we obtain outcomes j, k, and let 

s£S,teT a<=A,b£B 

Then q = ^2j k qjk r jk < m & x jk r jk- Let u,v be such that r u>v = ma,Xj k rj k . Hence, we can skip the 
initial measurement and instead use measurements Ag = A^ u , B\ = B\ v and state p = p UjV . □ 

This easy argument also immediately tells us that when srf and SB are abelian, we can find a 
classical strategy that achieves q: Just perform the measurement as above. If stf and SB are abelian, 
the remaining state will be one-dimensional and hence classical. 



A. 2 Tensor product structure 

We are now ready to prove Lemma 14. 1[ First, we examine the case where we are given a simple 
algebra srf G M(7i), for some Hilbert space 7i. We will need the following version of Schur's lemma. 

Lemma A.5. Let Z be the center ofM(H). Then Z = {cl\ c G C}. 

Proof. Let C G Z and let d = dm\(7i). Let £ = {Eij\i,j G [d]} be a basis for M(TC), where 
Eij := \i)(j\ is the matrix of all O's and a 1 at position Since C G Z and E^ G M(7i) we have 

for all i G [d] 

CEn = EnC. 

Note that CEn (or EnC) is the matrix of all O's but the ith column (or row) is determined by the 
elements of C. Hence all off diagonal elements of C must be 0. Now consider 

C(Eij + Eji) = (E^ + EjijC. 

Note that C(E{j + Eji) (or {Eij + Eji)C) is the matrix in which the iih and jth columns (rows) of 
C have been swapped and the remaining elements are 0. Hence all diagonal elements of C must be 
equal. Thus there exists some c G C such that C = cl. □ 

Using this Lemma, we can now show that 
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Lemma A. 6. Let C G M(Ha S3 He) be such that for all B G M(Hb) we have 



[C, (I A tg) B)] = 
TTien i/zere exists an A £ M(TCa) such that C = A (dis- 
proof. Let = dim(H J 4) and ds = dim('HB). Note that we can write any C G 8(7^,4 (8) "H_b) as 



c 



11 




for g£b x <ie matrices Cy. We have C(Ia ® B) = (Ia &> if and only if for all i,j G [cZa] 
Cjj-B = BCij, i.e., [Cjj,-B] = 0. Since this must hold for all B G M(TCb), we have by Lemma IA.5I 
that there exists some Ojj G C such that = a^-Is. Hence C = A (g) Ig with ^4 = [a^]. □ 

For the case that the algebra generated by Alice and Bob's measurement operators is simple, 
Lemma l4.1l now follows immediately: 

Proof of Lemma \4-l\ if gf is simple. Let g/ = ({A^}) C M(7i) be the algebra generated by Alice's 
measurement operators. If g/ is simple, it follows from Lemma IA.3I that g/ = M(H,a) ® Is for 
H = Ha ®T~Lb- It then follows from Lemma IA.6I that for all t G T and b G B we must have 
B\ G M(H B ). □ 

Thus, we obtain a tensor product structure! Recall that Lemma IA.4I states that for our appli- 
cation this is all we need. 

In general, what happens if g/ is not simple? Whereas our argument shows that there always 
exist measurement operations such that gf is simple, the solution found via optimization may not 
have this property. We now sketch the argument in the case where the g? is semisimple, which by 
Lemma lA.21 we may always assume in the finite-dimensional case. Fortunately, we can still assume 
that our commutation relations leave us with a bipartite structure. We can essentially infer this 
from von Neumann's famous Double Commutant Theorem [46} IT], partially stated here. 

Theorem A. 7. Let g/ be a finite- dimensional C* -algebra. Then there exists TC = TCa ®T~Lb such 
that 

j 

and 

Comm(^) = 01i ® (27) 
j 

Proof. (Sketch) We already know from Lemma IA.2I that g/ can be decomposed into a sum of 
simple algebras. Clearly, the RHS of Eq. (|27p is an element of Comm(^), To see that the LHS 
is contained in the RHS, consider the projection H^ onto H. A - Note that H^ G gf, and thus for 
any X G Comm(^) we have [X, H J A ] = 0. Hence, we can write X = YljO^A ® ^b)X(H j a Is), 
and thus we can restrict ourselves to considering each factor individually. The result then follows 
immediately from Lemma lA.61 □ 
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If we have more than two provers, the argument is essentially analogous, and we merely sketch 
it in the relevant case when the algebra generated by the prover's measurements is simple, since 
Lemma IA.4I directly extends to more than two provers as well. Suppose we have N provers 
Vx, . ■ . ,Vn and let 7i denote their joint Hilbert space. Let srf be the algebra generated by all 
measurement operators of provers Vx, ■ ■ ■ -Vn-i respectively. Then it follows from Lemma IA.6I 
and Lemma [A.3I that there exists a bipartite partitioning of TL such that TL = TLx,...,N-i ® Hn, 
srf = B(7^x,...,jV-i) and for all measurement operators M of prover Vn we have that M € M(TLn)- 
By applying Lemma fA.61 recursively we obtain that there exists a way to partition the Hilbert space 
into subsystems TL = TLx 35 • . . <8> TLn such that the measurement operators of prover Vj act on TLj 
alone. 

In quantum mechanics, we will always obtain such a tensor product structure from commuta- 
tion relations, even if the Hilbert space is infinite-dimensional. Here, we start out with a type-I 
algebra, the corresponding Hilbert space and operators can then be obtained by the famous Gelfand- 
Naimark-Segal (GNS) construction [36], an approach which is rather beautiful in its abstraction. 
In quantum statistical mechanics and quantum field theory, we will also encounter factors of type-II 
and type-Ill. As it turns out, the above argument does not generally hold in this case, however, 
there are a number of conditions that can lead to a similar structure. Sadly, we cannot consider this 
case here and merely refer to the survey article by Summers [55] . Note that in quantum mechanics 
itself, we thus have ui*(G) = uj^(G). 

B Tool 2: Positivstellensatz 

Here, we will provide the details for the proof of Theorem 14.31 For ease of reference, we first 
reproduce the theorem as follows: 

Theorem B.l. Let G = G(ir, V) be an N -prover game and let Cp be the cone generated by the set 
V defined in Section \4.S\ Set 

q u = ul- ^2 *(8i,...,s N ) V( ai ,...,a N \ Sl ,...,s N )X^ . . . X^ . ® 

si,...,Sjv ai,...,a N 

If Qv > 0, then q u G C-p, i.e., 

si,...,sjv ai,...,aj\r i i,j 

for some pi £ V, and some polynomials rj, Sj,-. 

We now prove the contrapositive statement of Theorem 14.31 In particular, we show that if q u has 
no representation as a WSOS, then q v and there exist operators and a state on some Hilbert 
space that achieve winning probability v. The proof proceeds in two stages. We first use the 
Hahn-Banach theorem to show (nonconstructively) the existence of a linear function that separates 
q v from the convex cone C-p and then use a GNS construction, as described below. Unfortunately 
we will not in general end up with operators on a finite-dimensional Hilbert space. 

We start by establishing some simple facts about C-p. 

Lemma B.2. Let W be the product of some number of variables from the set {Xgj}. Then I — 
W^W G C-p, and I - WW^ G C v . 
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Proof. The proof is by induction on n, the number of variables in the product W. For n = 1, we 
have to show that for all j, aj,Sj, I - (Xf 3 . ) 2 G Cp. We do this for I - (Xs- ) 2 . Writing 



a'Aj o'. 



(•-v;/) 2 .v 



+ 



(28) 



makes it clear that I — (Xf*) 2 G C-p. For n > 1, write W = VXgj , where we have assumed without 
loss of generality that the element Xg- is rightmost in W, and where V is the product of n — 1 
variables. Then 

I - W^W = I - Xsj VWX^ = I - {X a s i f + X a s ] (I - V ] V)X a s i . (29) 

Now I — (Xg-) 2 G Cp by the result for n = 1 and I — V^y G Cp by the inductive hypothesis. 
Moreover, for any polynomial r G C-p, and any arbitrary polynomial s, it is easy to see that 
r s G Cp. Hence, this implies that I — W^W G Cp. The argument for I — WW^ is analogous. □ 

Lemma B.3. Let p be a Hermitian polynomial. Then there exists a real number t > and an 
s G Cp such that p = s — 1 1. 

Proof. The polynomial p is a finite sum of terms of the form p' = w*vW^V + wv*V j; W, where V, W 
are products of the variables, w,v G C and w* is the complex conjugate of w (likewise for v*). If 
we can show the result for p', then the result for general polynomials p follows immediately. To 
this end, note that we can write 

p> = ( V *V ] + w*W ] ){vV + wW) - \v\ 2 V ] V - \w\ 2 W ] W (30) 

so that 

(M 2 + \w\ 2 )l + p = {v*V ] + w*W ] )(vV + wW) + M 2 (I - VW) + H 2 (I - W ] W) (31) 

which is in Cp by Lemma IB, 21 Taking t = |u| 2 + |ui| 2 , the result follows for p' , which in turn implies 
the result for general polynomials p. □ 

We now want to show that if q u is a Hermitian polynomial that does not lie in Cp, then there 
exists a linear functional that separates it from Cp. The following Lemma closely follows |23t 
Proposition 3.3] where the only difference is that we consider polynomials over complex instead 
of real Hermitian matrices. Fortunately, the essential ingredient of the proof, the Hahn-Banach 
theorem also holds in this case. We state entire proof for convenience: 

Lemma B.4. Let M be the space of Hermitian polynomials over complex matrices. Let q be a 
Hermitian polynomial such that q Cp. Then there exists a linear functional X : M — > R such that 
\{C V ) > 0, A(I) > 0, \(q) < 0. 

Proof. Let M be the space of Hermitian polynomials over complex matrices. Let \i : M — > R 
be a linear functional defined as fj,(p) := inf{t > : p = s — tl for some s G Cp}. Note that by 
Lemma lB.3( we can express any p G M in this form. Clearly, fj, is a seminorm on M. Note that 
for q Cp we have fi(q — I) > 1 by definition. We consider now a fixed q Cp and let L be the 
span of q — I in M, i.e., all Hermitian polynomials t{q — I) with t G R. Define a linear functional 
/ : L — > R so that f(t(q — I)) := t. It is not hard to see that / < fj, on L. Now we make the 
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first nonconstructive step. By the Hahn-Banach theorem [441 Theorem 3.3], / extends to a linear 
functional F : M — > R such that F(p) < fi(p) for all p £ M. 

We now claim that A = —F satisfies the requirements of the lemma: First of all, note that we 
have for all s £ C v that F(s) - F(q) + 1 = F(s — q + (q — I)) = F(s — I) < /i(s — I) < 1, where 
the first equality follows from the linearity of F, and the first inequality follows from F being an 
extension of /. Hence, F(s) < F(q). Clearly, we also have that for all s £ Cp and t > 0, ts £ Cp 
and hence tF(s) = F(ts) < F(q). Thus, if s £ Cp then F(s) < and F(q) > 0. Hence, A = —F 
satisfies A(C-p) > and X{q) < as required. 

It remains to show that A (I) > 0. First of all, note that I £ C-p. Suppose that on the contrary 
we have A(I) = 0. Let p £ C-p and note that by Lemma lB.31 we may write —p = s — tl for some 
t > and s £ C-p. From tl = s + p, we have = t\(I) = X(tT) = A(s) + X(p) > and hence 
A(s) = X(p) = for all p £ C-p. Now note that since I — q £ M we may write I — q = r — s for some 
r,s £ C-p. But then = A(r) — A(s) = A(I — q) = 1 which is a contradiction. □ 

The remainder of the proof of Theorem 5.2 is now exactly identical to [23], which in itself is 
analogous to the famous GNS construction [461 E] that allows us to find a representation in terms 
of bounded operators on a Hilbert space. We here provide a slightly annotated version of this 
approach in the hope that it will be more accessible to the present audience. 

Theorem B.5 (Helton and McCullough). Let M be the space of Hermitian polynomials. Let 
X : M — > ]R be a linear functional such that A (C-p) > and A (I) > 0. Then there exists a Hilbert 
space TL, bounded operators {X^ } on TL, and a state 7 £ TL such that for all p £ V we have 
p({Xs j }) > and for any Hermitian q £ M , 

<7|?({#/})|7> = A(?). 
Proof. First, we construct a Hilbert space TL from M: For s,t £ M, define 

(s\t) = -X{sh + tfs). 

It is easy to verify that {s\ t) is symmetric, bilinear and is also positive semidefinite whenever s = t, 
since s^s £ Cp and hence (s\ s) = A(s^s) > 0. Note that (-| •) is degenerate, but in order to obtain 
a Hilbert space, we need to turn (-| •) into an inner product. This can be done in the standard way 
by 'moding out' the degeneracy: Consider 

J = {s £ M I (s\ s) = 0}. 

It is not difficult to verify that J forms a linear subspace of M and that J is a left ideal of M We 
now consider the quotient space M/J ', which is the vector space created by the equivalence classes 

[x] = {x + j\j £ J}. 

Addition and scalar multiplication are defined via the following operations inherited from M : for 
x,y £ M and a £ C, we have [a; + y] = [x] + [y] and [ax] = a[x]. We can now define the inner 
product 

(Ml [y]) = (x\y). 
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It is important to note that this inner product does not depend on our choice of representative 
from each equivalence class, and we have eliminated the degeneracy present earlier. The Hilbert 
space is now obtained by forming the completion of Mj J with respect to this inner product. 

Second, we now need to show that there exists a representation 7r : M — > M(7i). We first define 
the action of ir(x) with x G M on the vectors [y] as 

X[y] = [xy], 

where we use the shorthand X = ir(x). It is straightforward to verify that this definition is 
again independent of our choice of representative from each equivalence class, and that ir is a 
homomorphism. For simplicity, we only show boundedness for operators {X^} G M. To see that 
X = ir(x) for x G {X^.} is bounded, note that by Lemma lB.21 we have I — x^x G Cp and that 

{X[s]\ X[s]) = (xs\ xs) = (s\ s) - A(s t (I - x ] x)s), 

where A(s^(I— x^x)s) > 0, since s' (I— x^x)s G Cp. From Lemma [B.2l we also have that I — xx^ G Cp, 
and hence the argument for ir(x^) is analogous and we may write X< = 7r(x^) without ambiguity. 
Hence we can find claimed operators {Xs-} G M(7i). 

Third, we need to define the vector 7. Since I G M we choose 7 = [I]. Hence, (7) 7) = A(I) > 0, 
and thus 7 is non-zero. Let q G M and write q(X) for the polynomial where variables Xj have been 
substituted by their representations Xj. Note that 

(q(X) 7 \ry) = \(q), 

where we have used the fact that q is a Hermitian polynomial. By a similar argument, it follows 
that for p G Cp and r G M we have 

(p{X)[r} \ [r]) = A(rV) > 0, 

since r^pr G Cp and hence p(X) > as promised. □ 

We can now complete the proof of Theorem 14.31 

Proof of Theorem \4-3\ Recall that our goal was to prove the contrapositive: If q v ^ Cp then q v ~~f> 0. 
From Lemma lB.41 we have that if q v ^ Cp , then there exists a linear functional A that separates q u 
from Cp. Lemma fB . 51 gives us that there exists a Hilbert space H, measurement operators {Xs-}, 
and a vector 7 such that 

KQu) = (l\qA{X? j })\j)<0. 

and the operators satisfy all the constraints, i.e., for all p G V we have p({Xs^}) > 0. (Note that 
we only have equality constraints, which we implemented by including both p and — p in V.) Since 
7 is not zero, we have q v ^ which completes the proof. □ 

Unfortunately, Theorem IB.5I does not tell us whether the underlying Hilbert space H is finite- 
dimensional, or whether the algebra generated by the operators {X s .} is type-I at all. Hence, we 
cannot ensure without further proof that the fact that our measurement operators do satisfy the 
commutation constraints necessarily leads to them having tensor product form. Thus, we do not 
know whether there exist games G for which u>*(G) < ujf(G): for such games we may would have 
to get a type-II or type-Ill algebra. 
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C Tool 3: Semidefinite Programming 



A semidefinite program (SDP) is an optimization over Hermitian matrices |47] , The objective 
function depends linearly on the matrix variable and the optimization is carried out subjected 
to the matrix variable being positive semidefinite and satisfies various affine constraints. Any 
semidefinite program may be written in the following standard form [6] : 

maximize — Tr [Go 2] , (32a) 
subject to Tr [G k Z] = b k V k, (32b) 
Z > 0, (32c) 

where Go and all the G^'s are Hermitian matrices, and the b k are real numbers that together specify 
the optimization; Z is the Hermitian matrix variable to be optimized. 

An SDP also arises in the inequality form, which seeks to minimize a linear function of the 
optimization variables (x\,X2, ■ ■ ■ ,x n ) € M n , subjected to a linear matrix inequality: 

minimize b' k x k (33a) 
subject to Fq + x k F k > 0. (33b) 

k 

As in the standard form, Fq and all the F k s are Hermitian matrices, while (6^, b' 2 , . . . , b' n ) is a real 
vector of length n. 



D Some Other Miscellaneous Details 

D.l Implementing Lowest Level SDP Relaxations for I 332 2 

Here, we will provide the explicit form for the matrices F k and constants b' k that define the SDP 
used in the lowest level relaxation for finding an upper bound on uj* (I3322 ) • Note that as with the 
CHSH case, in the lowest level relaxation, we shall choose s« in Eq. (jHJ) as multiples of I. To this 
end, we will write the SDP in the inequality form as 

6 

minimize b' u v + b' k x k (34a) 

k=l 
6 

subject to T = F + vF u + Y^ x k F k > 0. (34b) 

k=l 

In particular, we will set 
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and for k = 1,2,..., 6, we shall choose F k such that its only nonzero entries are [-Ffejife+i = 
= 1/2 and [F k ]k+i,k+i = — 1- Correspondingly, b' k is chosen such that b'^ = 1 and b' k = 
for k = 1, 2, . . . , 6. With this choice of F k , b' k and with z given by Eq. (fT7|) . it is easy to see that 
the matrix inequality constraint, Eq. (|34bj) . ensures that 

z ] T z = z^ (f + vF u + Y, *kF k \ z = -£3322 + v I + x kPk = SOS 

V k=l J k=l 

where p k s are defined in Eq. (|19j) and the last equality follows from the positive semidefiniteness 
of r. 



D.2 Implementing Higher Level SDP Relaxations for ^3322 

In what follows, we will give a sketch of how the level 2 relaxation for I3322 inequality with z given 
by Eq. (f20|) can be implemented as an SDP in the inequality form, Eq. (|33|) . Specifically, we want 
to write Eq. (fl6|) as: 

minimize u, 

subject to F + vF v + ^ x k F k > 0, (35) 

k 

where, as with the lowest level relaxation, Fq and F v are real and symmetric matrices chosen such 
that 

z s F Q z = -£3322, z s F v z = I. (36) 

Hereafter, we will focus on writing the second sum in Eq. ([8]) as ^2 k x k z'F k z for some appropriate 
choice of Hermitian matrix F k where x k is some variable to be optimized. As opposed to the lowest 
level relaxation, the most general second level relaxation would require that each Sij in Eq. ([8]) is 
a polynomial of degree at most 1. Let = ^2 k \ij k M k where M k is the £;-entry of the vector 
/i = (I, Af , A%, A%, B\, B\, B^y which consists of all degree 1 or lower monomials that can be found 
in z. For a fixed i and j, we thus have 

4j Pi s ij =J2 M k i X ijk X ijl) Pi M l = ^ A ij PiA»i ( 37 ) 
k,l 

where here X*- k is the complex conjugate of Xijk, PiU is a vector formed by multiplying each entry 
of fx by pi and Ay is a 7 x 7 matrix with its (k, Z)-entry given by tfj^Kji- Clearly, as it is, Ajj is a 
rank 1 but otherwise arbitrary positive semidefinite matrix. Analogously, we see that if we further 
perform a sum over j in Eq. ([37]) . then we may write ^ - s-piSij = f^AiPi/j, where Aj = Ylj^-ij 
is now an arbitrary positive semidefinite matrix. Moreover, the requirement of Aj being positive 
semidefinite can also be removed if we recall the fact that in the case of ^3322 inequality, if is in 
V, so is — pi. Then, what remains to be done is to express Ylj s\jPiSij and hence ^AiPifi in the 
form z^QiZ for some Hermitian fij. Evidently, the entries in A, will be related to the entries in J7j 
linearly. For example, since 

[MhMpiMs =[A 1 ] 6 , 5 (i?2 fe ) t [(AD 2 - [AD] {B\) 

=[A!] 6 , 5 \{AlB b 2 )\AlB\) - (BN(A$B>) 
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we may make the following identification [fiijg^ = — [^i]6,8 = [Ai]e5 an d so on. Each independent 
entry of Aj therefore corresponds to an independent optimization variable x k and some Hermitian 
matrix F k via Oj. In the example above, the F k corresponding to (the real part of) [Ai]6 5 would 
be zero everywhere except for its (6,8), (9,8), (8,6) and (8,9) entry, which reads as —1,1,-1,1 
respectively. More intuitively, each of these F k s gives rise to some polynomial identities such that 
z'F k z = whenever the constraints are satisfied. Putting everything together, we see that the 
search for a positive semidefinite T such that vl — -63322 — JZa s \-;Pi s a = z^Yz can also be written 
as the search for a positive semidefinite T such that 

k 

for some appropriate choice of F k . Comparing this with Eq. (|35p and Eq. (|36p , we see that evidently 
any higher order relaxation in our hierarchy can also be implemented as an SDP. 



D.3 Yao's inequality 

Here, we note that for {Ai, Bj,Ck}i j t k=i,2,3 satisfying the commutation relations JBj] = 0, 
[Ai, C k ] = 0, [Bj,C k ] = and for T given by Eq. (j2g]h we have 



3V3I -B Ya , 



l ijk li dk 



, 1 ' ( f {A) AB) AC) AA) t AB) t AC) t 

1 9 /Q ' ' \J ijh J ijk ' J ijk ' J ijk ' J ijk ' J ijk 
LZV6 i,j,k 



(39) 



where t ijk := AiBjC k , 
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and the second sum YJ is over all possible i,j, k such that i / j 7^ k. In contrast with Eq. (I26jh 
the above equality holds even if none of the constraints Af = B? = C| = I are satisfied. Moreover, 
the above equality can also be cast in the form of Eq. ([8]) with the help of identities such as 
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Z ijk Z ^k—P k +<^kPj ^k+9j k Pi gjk, 
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•* ijk ^ i 



„t (i) . t {A) t I {A) . {A)\ f I (A) , 

2g l jk p\ 'gjk + WkjPi 9kj-g ] jk (p) +p\ ')9jk-g kj (p) +p k 
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+ (^-fe + fi'fcj) 1 Pj A) {gjk + fffci) + (gjk + 5fcj) T + 9kj) 

- 2 (5jfc + gkj) ] p\ A) (gjk + 9kj) , 



tJA) 



where g jk := BjC k . 
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